Classical Flexible Lip Model Based Relative Weight Finder for Better Lip Reading Utilizing Multi Aspect Lip Geometry
نویسندگان
چکیده
Problem statement: Deaf and dumb needs assistance from a technical box that takes movements of lips to identify the words. This technical article provided appropriate model implementation of flexible lip model for better visual lip reading system. Approach: From the frame sequence of words, Active Shape Model (ASM) based lip model provided local tracking and extraction of geometric lip-feature. Two geometric criteria define required geometric features and its variations in the sequence. Results: The feature established machine classification using Analytic Hierarchy Process (AHP), a relative weight finder. AHP presents weight vector to fuzzy classifier to decide the video frame sequence belonging to a respective word. Conclusion: The suggested model tested on a total of 5 different sample databases results in 83.2% accuracy over the other combinational algorithms.
منابع مشابه
لبخوانی و ادراک گفتار دانشآموزان کمشنوای مدارس ویژۀ کمشنوایان در شهر تهران
Objective: The goal of this study was to evaluate the lip reading ability and Speech perception of hearing impaired students of special schools for the hearing impaired in different speech levels. Materials & Methods: In this cross- sectional study, 44 deaf students (9-12 years old) were selected with multi-stage cluster sampling method, from two special schools for the deaf in Tehran. Tools...
متن کاملDesigning and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods
For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...
متن کاملImproving Lip-reading with Feature Spac Audio-Visual Speech R
In this paper we investigate feature space transforms to improve lip-reading performance for multi-stream HMM based audio-visual speech recognition (AVSR). The feature space transforms include non-linear Gaussianization transform and feature space maximum likelihood linear regression (fMLLR). We apply Gaussianization at the various stages of visual front-end. The results show that Gaussianizing...
متن کاملNasoalveolar Molding: A new Method for Cleft Lip and Palate Rehabilitation
Introduction: Cleft lip and palate is a congenital anomaly occurring in 3 in 1000 live birth. One the major concern in this patient is about cleft gap and its surgical problems. Several surgical and non-surgical procedures have been done to decrease this gap. They aimed to achieve the more esthetic results as well as feeding success. Nasoalveolar Molding (NAM) is a new method for reshaping nasa...
متن کاملAutomatic Lip Reading for Daily Indonesian Words Based on Frame Difference and Horizontal-vertical Image Projection
Automatic lip reading is one of research being developed lately. Automatic lip reading has been used for various purposes, such as enhancing speech recognition and aid to speech training for the deaf. There are two approaches in lip feature extraction, namely appearance based and shape based. Appearance based approach is usually better, because it provides visual features that cover not only li...
متن کامل